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(54) APPARATUS AND METHOD FOR REPAIRING IMAGE 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an apparatus and a method 
for repairing a blurred image with high quality regardless of the 
distance to an object. 

SOLUTION: An image pickup section (4) generates an image signal 
corresponding to the image of a field formed through an image 
pickup optical system (3). A point image distribution function 
generating section (7) generates a point image distribution function 
dependent on the distance based on two-dimensional distance 
distribution information of the field detected at a distance detecting 
section (5), and an image blur signal during exposure period 
detected at a blur detecting section (6). An image repairing section 
(8) divides the image signal into partial images based on the 
distance distribution information, performs image processing for 
repairing blur of each partial image using the point image distribution 
function dependent on the distance and generates the entire image 
by synthesizing the repaired partial images. 
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(57)Abstract: 

PROBLEM TO BE SOLVED: To provide an apparatus and a method 
for repairing a blurred image with high quality regardless of the 
distance to an object. 

SOLUTION: An image pickup section (4) generates an image signal 
corresponding to the image of a field formed through an image 
pickup optical system (3). A point image distribution function 
generating section (7) generates a point image distribution function 
dependent on the distance based on two-dimensional distance 
distribution information of the field detected at a distance 
detecting section (5), and an image blur signal during exposure 
period detected at a blur detecting section (6). An image repairing 
section (8) divides the image signal into partial images based on the 
distance distribution information, performs image processing for 
repairing blur of each partial image using the point image 
distribution function dependent on the distance and generates the 
entire image by synthesizing the repaired partial images. 
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* NOTICES * 

JFO and NCI PI are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The photography optical system which forms the image of a field on a predetermined screen, and the 
image pick-up section which picturizes the image of the field formed on said screen, and generates a picture 
signal, The distance detecting element which detects the distance of the field on said screen and generates 
distance information, The Bure detecting element which detects Bure at the time of the image pick-up of said 
photography optical system, and generates the Bure signal, Image restoration equipment characterized by 
consisting of said distance information, the point spread function generation section which generates the point 
spread function according to distance based on said Bure signal, and the image restoration section which 
restores said picture signal using said point spread function, and forms a restoration image. 
[Claim 2] In image restoration equipment according to claim 1 said distance detecting element While detecting 
two-dimensional distance distribution of a field and dividing field distance into two or more distance zones 
based on said distance distribution information Two or more distance data representing each distance zone are 
computed, and said point spread function generation section generates two or more point spread functions 
which responded to said two or more distance data. Said image restoration section While dividing a picture 
signal into two or more partial images according to said distance zone Image restoration equipment 
characterized by restoring using the point spread function according to the distance data for this every partial 
image, forming two or more partial restoration images, and forming said restoration image by compounding 
these two or more partial restoration images. 

[Claim 3] The information read-out section which reads image information, distance information, and the Bure 
information from the record medium with which the image information which picturized the field, the distance 
information on the field at the time of an image pick-up, and the Bure information at the time of an image pick- 
up were recorded, Image restoration equipment characterized by consisting of the point spread function 
generation section which generates the point spread function according to distance, and the image restoration 
section which restores said picture signal using said point spread function, and forms a restoration image based 
on said distance information and said Bure information. 

[Claim 4] The step which forms the image of a field on a predetermined screen, and the step which picturizes 
the image of the field formed on said screen, and generates a picture signal, The step which detects the distance 
of the field on said screen and generates distance information, The step which detects Bure at the time of an 
image pick-up, and generates the Bure signal, and said distance information and the step which generates the 
point spread function according to distance based on said Bure signal, The image restoration approach 
characterized by consisting of a step which restores said picture signal using said point spread function, and 
forms a restoration image. 



[Translation done.] 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the image restoration equipment and the image restoration 
approach of restoring the image which deteriorated for blurring etc. in the image which does not have Bure by 
the image processing. 
[0002] 

[Description of the Prior Art] The image which deteriorated by Bure from the former is restored, and the 
technique which restores the image of the origin which does not have Bure is known. For example, in JP,62- 
127976,A, image degradation by Bure at the time of photography is expressed with a point spread function, and 
the Bure image is restored based on this point spread function. 

[0003] For example, data processing of image restoration is performed as follows. That is, if (x, y) are made 
into the position coordinate on a screen and image information when a point fades the image information of the 
image which deteriorated the image information of an image in case there is not Bure by Function f (x y) and 
Bure by Function g (x y) and Bure is made into a point spread function h (x y), the relation of a formula 1 will 
be realized. 
[0004] 
[Equation 1] 

T(x,y)*h(x l y)=g(x,y) 

[0005] * is a notation showing a convolution operation here. If the Fourier transform of the both sides of a 

formula 1 is carried out, a formula 2 will be realized in a frequency domain. 

[0006] 

f Equation 2] 
( u , v)xH (u f v)=G (u, v) 

[0007] Functions G, F, and H are the fourier transform functions of Functions g, f, and h, and u and v express 
the frequency of x and the direction of y here, respectively. It will become a formula 3 if the both sides of a 
formula 2 are **(ed) by H (u, v). 
[0008] 

t Equation 3] 
(u,v)=Q(u l v)/H(u,v) 

[0009] If the inverse Fourier transform of the formula 3 is furthermore carried out, the function f (x y) which is 
the image information of the origin which does not have Bure will be obtained like a formula 4. 
[0010] 
[Equation 4] 

f (x, y? = S (F (u, v) ) 
=S(G( Uj v)/H(u,v)) 

[001 1] S ( ) expresses an inverse Fourier transform here. That is, the Fourier transform of the image function 
which deteriorated by Bure is performed, and if this is **(ed) with the Fourier transform of the point spread 
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function by Bure and carries out inverse Fourier transform further, it can ask for the image function of the origin 

which does not have Bure. 

[0012] 

[Problem(s) to be Solved by the Invention] However, when the above-mentioned conventional technique was 
applied to the image picturized actually, a good result was not necessarily obtained. 

[0013] For example, the Bure restoration was inadequate to the image and close-up photography image with 
which two or more bodies with which distance differs exist in the same screen. 

[0014] Then, this invention aims at offering the Bure image restoration equipment and the Bure image 
restoration approach of performing the Bure image restoration good also to the image and close-up photography 
image with which the photographic subject of a different distance all over a screen was intermingled. 
[0015] 

[Means for Solving the Problem] In order to attain the above-mentioned object, with the image restoration 
equipment by invention according to claim 1 The photography optical system which forms the image of a field 
on a predetermined screen, and the image pick-up section which picturizes the image of the field formed on said 
screen, and generates a picture signal, The distance detecting element which detects the distance of the field on 
said screen and generates distance information, The Bure detecting element which detects Bure at the time of 
the image pick-up of said photography optical system, and generates the Bure signal, It is characterized by 
consisting of said distance information, the point spread function generation section which generates the point 
spread function according to distance based on said Bure signal, and the image restoration section which 
restores said picture signal using said point spread function, and forms a restoration image. 
[0016] In invention according to claim 2, it sets to image restoration equipment according to claim 1. Said 
distance detecting element While dividing field distance into two or more distance zones based on said distance 
distribution information Two or more distance data representing each distance zone are computed, and said 
point spread function generation section generates two or more point spread functions which responded to said 
two or more distance data. Said image restoration section While dividing a picture signal into two or more 
partial images according to said distance zone, it is characterized by restoring using the point spread function 
according to the distance data for this every partial image, forming two or more partial restoration images, and 
forming said restoration image by compounding these two or more partial restoration images. With the image 
restoration equipment by invention according to claim 3 The information read-out section which reads image 
information, distance information, and the Bure information from the record medium with which the image 
information which picturized the field, the distance information on the field at the time of an image pick-up, and 
the Bure information at the time of an image pick-up were recorded, Based on said distance information and 
said Bure information, it is characterized by consisting of the point spread function generation section which 
generates the point spread function according to distance, and the image restoration section which restores said 
picture signal using said point spread function, and forms a restoration image. By the image restoration 
approach by invention according to claim 4 The step which forms the image of a field on a predetermined 
screen, and the step which picturizes the image of the field formed on said screen, and generates a picture 
signal, The step which detects the distance of the field on said screen and generates distance information, It is 
characterized by consisting of the step which detects Bure at the time of an image pick-up, and generates the 
Bure signal, said distance information and the step which generates the point spread function according to 
distance based on said Bure signal, and a step which restores said picture signal using said point spread 
function, and forms a restoration image. 
[0017] 

[Embodiment of the Invention] Even if we were the same amounts of Bure wholeheartedly as a result of 
research, the amounts of dotage produced by Bure differed according to photographic subject distance, and, 
moreover, that the amount of dotage by Bure becomes large rapidly for a short distance traced that it was the 
cause by which the Bure restoration becomes imperfection to the image and close-up photography image with 
which two or more bodies with which distance differs exist in the same screen. That is, with the conventional 
Bure image restoration technique, since the uniform point spread function (dotage) was assumed and the Bure 
image restoration was performed, without taking photographic subject distance into consideration, it became 
clear that the Bure restoration was inadequate. 

[0018] In this invention, two or more bodies with which distance differs enabled good Bure restoration to the 
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image and close-up photography image which exist in the same screen by restoring the Bure image based on the 
point spread function according to distance. Hereafter, the operation gestalt of this invention is explained with 
reference to a drawing. Drawing 1 is the block block diagram showing the concept of the image restoration 
equipment by this invention. 

[0019] In drawing 1 , image restoration equipment 1 consists of the photography optical system 3, the image 
pick-up section 4, the distance detecting element 5, a Bure detecting element 6, the point spread function 
generation section 7, and the image restoration section 8. The photography optical system 3 forms the image of 
a field 2 on a predetermined screen. It consists of solid state image pickup devices which picturize the image of 
the field 2 formed on the predetermined screen, such as CCD and CMOS, and a control circuit of those, the 
exposure time (charge storage time) of a solid state image pickup device is controlled by the control circuit 
according to the brightness of a photographic subject image, and the image pick-up section 4 generates the 
picture signal corresponding to the image of a field. The distance detecting element 5 is constituted by well- 
known distance detection equipment, detects two-dimensional distance distribution of the field formed on the 
predetermined screen, and generates distance distribution information. The Bure detecting element 6 detects 
Bure of the photography optical system 3 in the image pick-up period by the image pick-up section 4, is a 
means to generate the Bure signal which changes in time, and consists of angular- velocity sensors etc. 
[0020] The point spread function generation section 7 generates a different point spread function for every 
distance according to the distance distribution information and the Bure signal of a field. A point spread 
function is a function showing intensity distribution when a point fades by Bure here. 

[0021] With the point spread function with which the point spread function generation section 7 generates the 
picture signal which deteriorated by Bure whom the image pick-up section 4 generates, according to distance 
distribution information, the image processing of the image restoration section 8 is carried out, and it generates 
the picture signal which restored degradation by Bure. 

[0022] Drawing 2 is the block block diagram of the example at the time of applying this invention to a digital 
still camera 1 0. 

[0023] Photo electric translation of the photographic subject image formed with the taking lens 1 1 is carried out 
by the solid state image pickup device 12 of charge storage molds, such as CCD, and a picture signal is 
outputted. A picture signal is changed into a digital picture signal by the AD translation means 1 8, and is stored 
in the volatile memory 19, such as RAM. It is recorded on the record medium 21 of non-volatiles, such as 
CompactFlash (trademark) memory, while image display of the picture signal stored in memory 19 is carried 
out by the liquid crystal display means 20. CPU (central -process control means) 17 performs control of above- 
mentioned image pick-up actuation, storing actuation, a display action, and record actuation. 
[0024] The angular- velocity sensor VI 3 and the angular- velocity sensor H14 are the Bure detection sensors for 
detecting blurring of a digital still camera 10, detect the angular velocity of the digital still camera 10 of the 
circumference of two shafts which intersect perpendicularly with the optical axis of a taking lens 1 1 , and 
intersect perpendicularly mutually on real time, and send it to CPU 17 by making a detection output into an 
angular- velocity signal. 

[0025] A distance robot 15 is a sensor for detecting two-dimensional distance distribution of a field, and 
mentions the detail later. 

[0026] The release carbon button 16 is a member operated by the photography person at the time of 
photography, and generates a release signal according to actuation. 

[0027] In addition, the above-mentioned digital still camera 10 is equipped with the non-illustrated optical 
finder, and, thereby, a photography person can observe a photographic subject. 

[0028] In the above configurations, CPU 17 acquires the distance distribution information on a field when a 
release signal is inputted from a distance robot 1 5 while detecting Bure of the taking lens 1 1 in an image pick- 
up period based on the angular- velocity signal from the angular- velocity sensor VI 3 and the angular- velocity 
sensor HI 4. CPU 17 generates a point spread function according to distance based on the Bure signal and 
distance distribution information. The below-mentioned image restoration processing is performed to the Bure 
degradation picture signal furthermore stored in memory 19 using these point spread functions, and the restored 
picture signal is re-stored in memory 19. The restored picture signal is recorded on a record medium 21 while it 
is displayed on the liquid crystal display means 20. 

[0029] The distance sensor 15 is explained to a detail here. Drawing 3 is drawing showing the configuration of 
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a distance robot 15, picturizes the image of the field formed with the ranging lens 42 by the two-dimensional 
image sensor 44 arranged behind [ E ] the ranging lens 42, and generates the image data of a field image. 
Moreover, the two-dimensional image sensor 45 arranged behind [ E ] the ranging lens 43 picturizes the image 
of the field formed with the ranging lens 42 and the ranging lens 43 with an equal optical property, and the 
image data of a field image is generated. In addition, the ranging lens 42 and the ranging lens 43 separate the 
base length B, and are juxtaposed. 

[0030] In such a configuration, the two-dimensional image sensor 44 corresponding to the point 46 in the 
strange distance d and the image formation points 47 and 48 on 45 serve as relation like drawing 4 . If the image 
spacing L of the image formation points 47 and 48 is measured based on the image data which the image 
sensors 44 and 45 generate, according to the principle of triangular ranging, distance d can be found with a 
formula 5. 
[0031] 
[Equation 5] 

d = BxE / (L-B) 

[0032] Moreover, if a ranging point is scanned on a screen and distance is measured, two-dimensional distance 
distribution of a field is detectable. Furthermore, distance distribution of the field in the inside of an image pick- 
up screen is [ the picture signal of a solid state image pickup device 12, and the image data of the two- 
dimensional images 44 and 45 ] detectable with matching ****** (a cutback/amplification, shift, etc.). 
[0033] Drawing 5 is the block diagram having shown more CPU 17 shown in drawing 2 , and the configuration 
of the circumference of it in the detail. The process of restoration of the picture signal which deteriorated by 
Bure is explained to a detail using drawing 5 . 

[0034] In drawing 5 , an angular- velocity signal is generated according to blurring which joins a digital still 
camera 10 from the angular- velocity sensor VI 3 and the angular- velocity sensor HI 4. The angular- velocity 
signal which is one dimension when a sine wave joins drawing 6 as blurring is shown. The AD translation of 
this angular- velocity signal is carried out with a predetermined sampling period, and it is changed into digital 
data, it integrates with the angular- velocity signal changed into the digital data by the integral operation part 31, 
it is changed into a signal (the relative include angle except an integration constant — a variation rate is 
expressed) whenever [ angular relation ], and is sent to the Bure distribution storage section 32. Drawing 7 
shows a signal whenever [ at the time of integrating with the angular relation speed signal of drawing 6 / 
angular relation ]. 

[0035] From the release carbon button 16, the release signal according to actuation by the photography person 
is sent to the photography control section 33 and a distance robot 15. In the photography control section 33, 
while controlling exposure of a solid state image pickup device 12 by the exposure time set up according to the 
release signal from photographic subject brightness, the sensibility of a solid state image pickup device 12, and 
the drawing value of a taking lens 1 1 , an exposure timing signal is transmitted to the Bure distribution storage 
section 32 by it. In the Bure distribution storage section 32, the angular relation speed signal in an exposure 
period is memorized according to an exposure timing signal. 

[0036] The two-dimensional condition of the data of a signal is shown whenever [ angular relation / which 
carried out drawing 8 in this way, and was memorized by the Bure distribution storage section 32 ], and the data 
value of whenever [ angular relation / which was sampled with the predetermined time interval during the 
exposure period ] is shown by the black dot. As shown in drawing 9 , the X-axis and a Y-axis are defined as 
intersecting perpendicularly mutually in the photography screen 41 . In addition, in theta x, in drawing 8 , the 
include angle of the circumference of the X-axis and thetay express the include angle of the circumference of a 
Y-axis. The total number of samplings in an exposure period is set to N here, and the n-th sampling is set to 
(thetaxn, thetayn). Moreover, it is changed so that the average of data may be set to (0, 0) whenever [ in the 
sampling of 1 - N time / angular relation ]. 

[0037] On the other hand, according to a release signal, a distance robot 1 5 measures distance distribution of the 
field photoed, and sends it to the distance distribution operation part 34. In the distance distribution operation 
part 34, the frequency of occurrence of the distance value in a photography screen is summarized based on the 
sent two-dimensional distance distribution at a histogram like drawing 10 . Using this histogram, according to 
the height of the frequency of occurrence, the field distance from a short distance to the infinite distance is 
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divided into some distance zones ( drawing 10 Zl , Z2, Z3, Z4), and the distance data ( drawing 10 dl , d2, d3, 
d4) used as the central value of that distance zone are elected. Moreover, the distance distribution operation part 
34 divides a picture signal into two or more partial images according to said distance zone. 
[0038] In the point spread function operation part 35, a signal is changed into the image Bure signal on a screen 
whenever [ angular relation / which was memorized by the Bure distribution storage section 32 ] based on the 
distance data called for by the distance distribution operation part 34. Drawing 1 1 is drawing which explains the 
principle of the conversion according to the distance from a signal to an image Bure signal whenever [ angular 
relation ], and since it is easy, it shows photography optical system with one lens 51. Moreover, the focal 
distance of a lens 51 is f. To the core 55 of Screen 54, a lens 51 include-angle thetay Inclines to the 
circumference of the y-axis, and considers the Bure ** case. The amount of image Bure of the direction of a 
screen x axis of the points 52 and 53 in the distance dl and d2 on this Tokimitsu shaft is asked for the distance 
from the photograph center 55 of the image points 56 and 57 corresponding to points 52 and 53 with a formula 
6 as XI and X2. 
[0039] 
[Equation 6] 

X1=d1xfxtan9y/(d1-f) 
X 2 = d 2xfxtan0y / (d 2-f) 

[0040] As shown also in a formula 6, in order to change so rapidly that the factor of d/(d-f) becomes at a short 
distance, change of the amount of dotage to as same the include-angle Bure as a short distance also becomes 
rapid. 

[0041] whenever [ angular relation / as shown in drawing 8 by the point spread function operation part 35 based 
on a formula 6 ] — a signal (thetaxn, thetayn) — the distance data dl and d2 — it changes into an image Bure 
signal (X In, Yin) and .. (X2n, Y2n) according to .. the continuous point spread functions hi (x y) and h2 (x y) 
as show a still more nearly discrete image Bure signal (X In, Yin) and .. (X2n, Y2n) to drawing 12 by 
technique, such as smoothing, — it is changed into .. 

[0042] the picture signal which deteriorated by Bure stored in the subject-copy image memory 36 in the image 
restoration section 38 — reading appearance — carrying out — this — receiving — point spread functions hi (x y) 
and h2 (x y) .. image restoration processing — giving — further — a part for the distance zone in a screen — 
image composition processing in which it responded comparatively is performed, a restoration picture signal is 
generated, and it stores in the restoration image memory 37. 

[0043] in addition, each point spread functions hi (x y) and h2 (x y) — the technique of having stated the 
technique of the image restoration processing by .. to the formula 1 - the formula 4 is applied. 
[0044] Drawing 13 is image drawing of the above-mentioned processing. The image information 62 which was 
divided into two or more parts and has been recognized according to a distance zone (Zl , Z2, Z3, Z4) is 
obtained from the image 61 which deteriorated by Bure first, next, the point spread function hi (x — ) with 
which the image 61 which deteriorated by Bure was defined according to representation distance data (dl, d2, 
d3, d4) Image restoration processing is carried out by y), and h2 (x y), h3 (x y) and h4 (x y), respectively, and 
the partial images 63, 64, 65, and 66 divided for every distance are farther extracted from the restored image by 
image information 62. The partial images 63, 64, 65, and 66 divided at the end are compounded, and the 
restoration image 67 is generated. 

[0045] Drawing 14 to drawing 1 6 is flow chart drawing having shown the program of CPU 17 explained by 
drawing 2 of operation. In addition, as a solid state image pickup device, it explains using CCD. Drawing 14 is 
the main program of CPU 17, and a timer interruption program for drawing 1 5 to carry out the AD translation of 
the angular-velocity signal with a predetermined time interval and drawing 16 are release interruption programs 
started with a release signal. It has the composition that the processing program of the timer interruption of 
drawing 15 and drawing 16 and release interruption interrupts suitably, and is executed during main program 
activation of drawing 14 here. 

[0046] In drawing 14 , actuation of CPU 17 starts by power-source ON of a digital still camera 10. In SI 01, reset 
of CCD of operation and reset of timers are performed, and timer interruption and a release interruption 
interrupt are permitted after that. In SI 02, the charge storage time (exposure time) of CCD is calculated 
according to information (photographic subject brightness, pixel sensibility, drawing value, etc.) required for 
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the decision of the exposure time. SI 02 is repeated henceforth. 

[0047] Drawing 15 is the flow chart of the program of a timer interruption, in S201, carries out the AD 
translation of the angular- velocity signal, and stores it in memory. Even the newest data integrate S202 with the 
angular- velocity data stored in memory, and a signal is calculated whenever [ angular relation ]. In S203, the 
return of the signal is stored and carried out to memory whenever [ angular relation / which was calculated ]. 
[0048] Drawing 16 is the flow chart of the program of a release interrupt, in S301 , from a distance robot, it 
incorporates distance distribution information, creates a distance histogram, and computes and memorizes 
representation distance data according to a distance zone. CCD is made to picturize based on the newest 
exposure time in S302. A picture signal is made to sweep out from CCD in S303, the AD translation of this 
picture signal is carried out in S304, and the temporary storage of the picture signal after an AD translation is 
carried out to memory in S305. In S306, the picture signal stored in memory is recorded on a record medium. In 
S307, a picture signal is divided into a partial image according to a distance zone. In S308, the point spread 
function according to representation distance data is calculated from a signal and representation distance data 
whenever [ angular relation / which is stored in memory ]. In S309, while the point spread function according to 
representation distance data performs an image restoration processing operation, a restoration image is extracted 
for every part divided according to the distance zone. In S3 10, the image restored for every part is compounded 
and an overall restoration image is generated. In S3 1 1 , the compounded restoration image is recorded on a 
record medium, and it returns to SI 02. 

[0049] Also the case where two or more photographic subjects of a different distance all over a screen exist, and 
in the case of close-up photography photography, by performing the Bure image restoration processing with the 
optimal point spread function according to distance as mentioned above, Bure restoration can be performed 
good. 

[0050] (Explanation of a deformation gestalt) Various deformation and modification are possible for this 
invention, without being limited to the operation gestalt explained above. 

[0051] Although two-dimensional distance distribution of a field is detected, two or more point spread functions 
are prepared according to distance and the Bure image is restored in the example shown in drawing 5 , it is not 
necessary to necessarily detect two-dimensional distance distribution. For example, only the distance to the 
body used as main photographic subjects is measured, the point spread function according to the distance is 
generated, and this point spread function may be made to perform the whole image restoration. Even if it 
performs such processing, since the image of the body in a different distance from main photographic subjects 
has already faded by focal dotage, there is little possibility of producing a problem. Since the distance detection 
equipment for detecting two-dimensional distance distribution becomes unnecessary and there should just be 
distance detection equipment of a cheap simple configuration if it does in this way, it becomes easy to build 
image restoration equipment into a digital still camera etc. 

[0052] Moreover, although the example shown in drawing 5 explained as what image Bure generates by 
include-angle Bure of photography optical system, in contiguity photography, the effect of parallel Bure (Bure 
whom an optical axis shifts to parallel) of photography optical system also becomes large. In such a case, this 
parallel Bure signal is detected using the acceleration sensor for parallel Bure detection, and you may make it 
ask for the point spread function according to distance using this parallel Bure signal and distance data. 
[0053] Drawing 17 is drawing explaining the principle in the case of performing conversion to an image Bure 
signal from a parallel Bure signal according to distance, and has given the same number to the same component 
as drawing 1 1 . The case where a lens 5 1 shifts only R in the direction of a x axis by such configuration is 
considered. The amount of image Bure of the direction of a screen x axis of the points 52 and 53 in the distance 
dl and d2 on this Tokimitsu shaft is asked for the distance from the photograph center 55 of the image points 56 
and 57 corresponding to points 52 and 53 with a formula 7 as XI and X2. 
[0054] 
Equation 7] 

'1=f XR/(d1-f ) 



X2=f xR/(d2-f ) 

[0055] If distance d becomes close to a focal distance f in contiguity photography as shown also in a formula 7, 
the amount of dotage to parallel Bure will also increase rapidly. According to distance, parallel Bure can be 
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changed into image Bure by the transformation of a formula 7, and it can ask for the point spread function 
according to this image Bure. Thus, by applying the point spread function for which it asked to the example of 
drawing 5 , image Bure who arises by parallel Bure can also do image restoration according to distance. 
[0056] According to the above example, it becomes possible to carry out image restoration of image Bure at the 
time of contiguity photography good. Moreover, by combining above-mentioned parallel Bure's image 
restoration, and the image restoration by said include-angle Bure, the effectiveness of image restoration can be 
heightened further. 

[0057] Moreover, in the formula 6 and formula 7 which change include-angle Bure and parallel Bure into the 
amount of image Bure, when a taking lens lets out greatly for contiguity photography, a focal distance f lets out 
and it changes a lot according to an amount, it is possible to amend a formula 6 and a formula 7 with the 
amount of lens deliveries, a photography scale factor, etc. suitably. Moreover, in the example of drawing 2 or 
drawing 5 , although the angular- velocity sensor was used as a Bure detection sensor, it may not be limited to 
this and an acceleration sensor and an image sensor (a time motion of an image detects image Bure) may be 
used. 

[0058] Moreover, in the example of drawing 2 and drawing 5 , although the distance detection equipment of the 
triangular ranging method of a passive mold was used as a distance robot Not the thing limited to this but the 
so-called active type of triangular distance measuring equipment (meet a predetermined optical axis and beam 
light is emitted to a field side) measuring the image formation location of reflective beam light according to 
beam light and the optical system which separated baseline length — distance — detecting — a field may be 
scanned and distance distribution may be measured. Moreover, you may make it detect distance distribution of a 
field by emitting an electromagnetic wave and an acoustic wave and measuring the return time amount of the 
reflected wave from a field. If it does in this way, when a field is comparatively dark, it will become possible to 
carry out range measurement to high degree of accuracy. 

[0059] Moreover, although the Bure image restoration is automatically performed within the digital still camera 
according to the release signal, in the example of drawing 2 and drawing 5 , a digital still camera reads distance 
information or distance distribution information, the Bure information, and a picture signal afterwards from a 
record medium, and it may be made to memorize distance information or distance distribution information, the 
Bure information, and a picture signal to the record medium for a while, and to restore the Bure image. Since 
the Bure image processing can be carried out to time amount with few burdens of a digital still camera if it does 
in this way, it is advantageous when performing a seriography. 

[0060] Moreover, distance information or distance distribution information, the Bure information, and a picture 
signal are memorized to the record medium for a while, the distance information from a record medium or 
distance distribution information, the Bure information, and a picture signal are read afterwards with a personal 
computer etc., and it may be made to restore the Bure image by the personal computer side. Since an image 
processing with more large operation magnitude can be performed while being able to lessen the burden of a 
digital still camera, if it does in this way, the quality of image restoration also improves. It is also possible to 
use the silver halide film other than memory card ** as a record medium. For example, while recording an 
image on the silver halide film equipped with the magnetic layer optically and recording magnetically distance 
information or distance distribution information, and the Bure information on said magnetic layer, you may 
make it the configuration which reads the distance information or distance distribution information which read 
said silver halide film with the scanner etc. in the personal computer, and extracted the picture signal, and was 
recorded on the magnetic layer by the magnetic head. If it does in this way, image restoration of this invention 
is applicable also to the photography system which used not only a digital still camera but the silver halide film. 

[0061] Moreover, in the example of drawing 2 and drawing 5 , a photography person's actuation input may be 
made to perform processing to which restoration processing of the Bure image divides the inside of a screen 
into two or more parts according to a distance zone although the Bure image restoration is automatically 
performed within the digital still camera interactively, displaying an image on a display etc. Since an intention 
of a photography person can be reflected also when automation processing is difficult if it does in this way, the 
Bure image restoration can perform more certainly. 

[0062] Moreover, since the image of the photographic subject of a distance zone which is separated from the 
setting-out distance of photography optical system has already faded by focal dotage, you may make it omit 
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restoration processing of the Bure image to the image of such a distance zone in the example of drawing 2 and 
drawing 5 , although the Bure image restoration processing was performed to the image of all distance zones. 
For example, the amount of focal dotage which extracted as the setting-out distance information on photography 
optical system, and was calculated from value information, and the amount of image Bure of a predetermined 
distance zone are measured, and when the amount of focal dotage is dominant, to the image of this distance 
zone, it is made not to perform the Bure image restoration processing. If it does in this way, it is possible to 
shorten image-processing time amount and to realize the high image restoration equipment of a response. 
[0063] Moreover, in the example of drawing 2 or drawing 5 , although the Bure image restoration is always 
performed according to the release signal, when the setting-out distance of the setting-out mode (highly minute 
recording mode with the low compressibility when recording the contiguity photography mode and the image 
which perform camera actuation suitable for close-up photography) of a digital still camera of operation, or 
photography optical system is set to a short distance side from predetermined distance, it may be made to 
perform die Bure image restoration processing. If it does in this way, since the Bure image restoration will be 
automatically performed only in the situation that the need for the Bure image restoration is high, at the time of 
photography, high photography of a response is usually attained. 
[0064] 

[Effect of the Invention] In image restoration equipment and the image restoration approach according to this 
invention as explained above In order to detect the distance of a field or distance distribution on a screen and to 
perform the Bure image restoration processing using the optimal point spread function according to distance or 
distance distribution, As compared with the case where it is not based on distance like before, but the Bure 
image restoration processing is performed using an uniform point spread function, the better Bure image 
restoration is attained, especially the effect of Bure is effective for the Bure restoration of a large contiguity 
photography image. 

[0065] Moreover, since the Bure restoration of an image which has in a screen two or more photographic 
subjects with which distance differs is also compounded in the whole restoration image after it performs the 
Bure image restoration selectively according to each distance, the good Bure restoration effectiveness is 
expectable. 
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* NOTICES * 

JPO and MCIPI are not responsible for any 
damages caused by the use of this translation. 

1 .This document has been translated by computer. So the translation may not reflect the original precisely. 

2 **** s hows the word which can not be translated. 
3. In the drawings, any words are not translated. 
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[Drawing 17] 
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